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Abstract. We propose a procedure to design a state-quantizer with finite alphabet for a 
marginally stable stochastic linear system evolving in W 1 , and a bounded policy based on 
the resulting quantized state measurements to ensure bounded second moment in closed- 
loop. 

1 . Introduction and Result 
Consider the linear control system 
(*) x t+ \ = Ax, + Bu, + w,, xo given, t = 0, 1, 

where the state x, e R d and the control u, e R m , (w,), e n is a mean-zero sequence of noise 
vectors, and A and B being matrices of appropriate dimensions. It is assumed that instead 
of perfect measurements of the state, quantized state measurements are available by means 
of a quantizer q : R d — > Q, with Q c R d being a set of vectors in R d called alphabets/bins. 

Our objective is to construct a quantizer with finite alphabet and a corresponding control 
policy such that the magnitude of the control is uniformly bounded, i.e., for some t/ max > 
we have ||m,|| < t/ max for all f, the number of alphabets Q infinite, and the states of (*) are 
mean-square bounded in closed-loop. 

Stabilization with quantized state measurements has a rich history, see e.g., [2, 4, 1, 
3, 7, 8] and the references therein. While most of the literature investigates quantiza- 
tion techniques for stabilization under communication constraints, especially of systems 
with eigenvalues outside the closed unit disc, our result is directed towards "maximally 
coarse" quantization — with finite alphabet of Lyapunov stable systems; communication 
constraints are not addressed in this work. The authors are not aware of any prior work 
dealing with stabilization with finite alphabet in the context of Lyapunov stable systems. 
Observe that unlike deterministic systems, local stabilization of stochastic systems with 
unbounded noise, at least one eigenvalue with magnitude greater than 1, and bounded in- 
puts is impossible. 

Assumption 1. 

o The matrix A is Lyapunov stable — the eigenvalues of A have magnitude at most 1, and 
those on the unit circle have equal geometric and algebraic multiplicities. 

o The pair (A, B) is reachable in k steps, i.e., rank {b AB ■ ■ ■ A K ~ l B} = d. 

° (wr)feNo ls a mean-zero sequence of mutually independent noise vectors satisfying C\ := 
su PkeN„ e DIw,I| 4 ] < oo. 

° Ikll < £/max for all f e N . 

The policy that we construct below belongs to the class of K-history-dependent policies, 
where the history is that of the quantized states. We refer the reader to our earlier article 
[6] for the basic setup, various definitions, and in particular to [6, §3.4] for the details 
about a change of basis in R d that shows that it is sufficient to consider A orthogonal. 
We let ^(A.M) := (A k ~ l M ■ ■ ■ AM m) for a matrix M of appropriate dimension, 
M + := M J (MM T y l denote the Moore-Penrose pseudoinverse of M in case the latter has 
full row rank, and <r min (M), cr max (M) denote the minimal and maximal singular values of 
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Figure 1. Pictorial depiction of the proposed quantization scheme in R 2 , 
with {qo = 0, qi, . . . , qg} being the set of bins. The various projections 
are computed for a generic state z outside the r-ball centered at the origin. 



M, resp. / denotes the dxd identity matrix. For a vector v € R rf , let n,,(-) := (•, and 
n^-(-) := /— n,,(-) denote the projections onto the span of v and its orthogonal complement, 
respectively. For r > the radial r-saturation function sat ( - : R d — > R d defined as sat r (v) := 
min{r, ||y||) jj^jj, and let B r c R d denote the open r ball centered at with dB r being its 
boundary. We have the following theorem: 

Theorem 2. Consider tlie system (*), and suppose that Assumption 1 holds. Assume that 
the quantizer is such that there exists a constant r satisfying: 

jfagWj)^ . c rn . M . . . , , , f , 

a) r > , where ip e [0, tt/4[ is the maximal angle between z and 

cos(^) - sin(^) 

q(z), z t B r , and 

b) q(z) = q(sat r (z)) e dB r for every z i B r . 

Finally assume that that t/ max > r/cr mm CR K (A, B)). Then successive K-step applications of 
the control policy 



-K(A,B) + A K q(x KI ), te 



\U K (t+\)-\) 

ensures that sup (eN() E Xo [||x f || 2 ] < oo. 



Observe that Theorem 2 outlines a procedure for constructing a quantizer with finitely 
many bins, an example of which on R 2 is depicted in Figure 1 . We see from the hypotheses 
of Theorem 2 that the quantizer has no large gap between the bins on the r-sphere, and is 
"radial"; the quantization rule for states inside B r does not matter insofar as mean-square 
boundedness of the states is concerned. As a consequence of the control policy in Theorem 
2, the control alphabet is also finite with k\Q\ elements. Moreover, note that as <p \ 0, i.e., 
as the "density" of the bins on the r-sphere increases, we recover the policy proposed in 
[6], and in particular, the lower bound on f/ m ax in [6]. 
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2. Proof of Theorem 2 



We assume that the random variables w t are defined on some probability space (£2, g, P). 
Herereafter E®'[-] denotes conditional expectation for a cr-algebra g' c g. 
We need the following immediate consequence of [5, Theorem 1]. 

Proposition 3. Let (^,) t eN be a sequence of nonnegative random variables on some proba- 
bility space (Q., g, P), and let CS r )teN be any filtration to which (^ r )ten is adapted. Suppose 
that there exist constants b > 0, and J, M < oo, such that £o *== J, and for all t: 

E 5 '[^+i - £,] < -b on the event {£, > J), and 

E[l£ + i-£| 4 |£),.-.,£]<M. 

Then there exists a constant y = y(b, J, M) > such that sup E[£, 2 ] < y. 

Proof of Theorem 2: Let g, be the cr-algebra generated by {x s | s = 0, . . . , f). Since q is 
a measurable map, it is clear that (q(x f ))( e N is (3r)(eN - a dapted. 
We have, for t e No, on {\\x a \\ > r), 

EMII.wJ| - IIjcJII = E«"[\\A K x Kt +<R K {A,B)u Kl + wj| - ||jtj|], 



where u K 



V M k(h-1)-1/ 



^+1)11 ~~ \\ x Kt\\ 



and w K , :- K^A, I) 



Wk, 



is zero-mean noise. To 



wit, we have 

E 5 "[||A^, + K(A, B)u Kt + wj| - 

< E s "[||A^ f + K(A,B)u Kt \\ - \\x Kt \\] + V^cr max (K(A,/))VQ- 

Selecting the controls u Kt — — ( R K {A,B) + A K (\{x K t) as in the theorem and using the fact that 
q(x Kl ) = Yi Xa {x Kt ) + IT^ fe), we arrive at 



■ \\x K , 



EH\\A K x Kl +'R K (A,B)a K 
= \\A K x Kt -A\{x Kt )\ 

< \\A K x K , - sat r (A%,)|| - \\x Kt \\ + \\nl(A K q(x Kt ))\\ 

+ ||sat r (A^ f ) - Tl Xa (A K (\(x Kt ))\\ 
= -r+ \\A K sat,.(x w ) - \l x JA\{x KI ))\\ + \\lL^(A K q(x K 
= -r+ \\A K sat r (x a ) - n^(A^(sat r (x w )))|| 

+ ||n^ ( (A"q(sat r (x„)))|| by hypothesis b) 

< — r + r(l - cos(y>)) + r sin(^) 

< —b for some b > by hypothesis a). 

Moreover, we see that for t e No, since A is orthogonal, 



E[ 



it+i) 



■ IbeJlf | {\\x KS \\} f s=0 ] = E[|||^ ( , + i)|| - HAVllf | (IMIrU] 
E[\\\A"x Kt + K(A, B)u« + K(A, 7)^11 - \\A K x Kt \\\ A \ [\\x KS \ 

< E[\\K(A,B)u Kt + K(A,I)w Kl \f |{||*JIH =0 ] < M 



for some M > since u Kt is bounded in norm and E[||w,|| 4 ] < C4 for each t. 

We let J := max{||xo|| ,r). It remains to define := \\x Kt \\ and appeal to Proposition 3 
with the above definition of {% t )tm to conclude that there exists some y - y(b, J, M) > 
such that sup (ENo E[£ 2 ] = sup, eNo E Xo [||x Kf || 2 ] < y. A standard argument, e.g., as in [6, 
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Proof of Lemma 9], shows that this is enough to guarantee sup rENo E Xo [||jc,|| 2 ] < y for some 

y > o. □ 

3. Simulation 

The figure below shows the average of the square norm of the state over 1000 runs of 
the system: 

/cos(7r/3) -sin(7!-/3)\ /l\ 
Xf+1= (sin(^/3) cos(n/3)) X ' + [o) U ' + W " 

where xq - (10 10) T , w t e N(0, h), and where u, is chosen respectively according to the 
policy proposed in this article and the one proposed in [6]. 
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